Bias ( The “ File - Drawer Problem ” ) in Scientific Inference
نویسندگان
چکیده
Publication bias arises whenever the probability that a study is published depends on the statistical significance of its results. This bias, often called the file-drawer effect since the unpublished results are imagined to be tucked away in researchers’ file cabinets, is potentially a severe impediment to combining the statistical results of studies collected from the literature. With almost any reasonable quantitative model for publication bias, only a small number of studies lost in the file-drawer will produce a significant bias. This result contradicts the well known Fail Safe File Drawer (FSFD) method for setting limits on the potential harm of publication bias, widely used in social, medical and psychic research. This method incorrectly treats the file drawer as unbiased, and almost always misestimates the seriousness of publication bias. A large body of not only psychic research, but medical and social science studies, has mistakenly relied on this method to validate claimed discoveries. Statistical combination can be trusted only if it is known with certainty that all studies that have been carried out are included. Such certainty is virtually impossible to achieve in literature surveys.
منابع مشابه
Publication Bias: The “File-Drawer” Problem in Scientific Inference
Publication bias arises whenever the probability that a study is published depends on the statistical significance of its results. This bias, often called the file-drawer effect because the unpublished results are imagined to be tucked away in researchers’ file cabinets, is a potentially severe impediment to combining the statistical results of studies collected from the literature. With almost...
متن کاملA novel approach to the anaesthetic management of a case of osteogenesis imperfecta
1. Harsoor SS, Bhaskar SB. Learning research methodology: Revisiting the evidence. Indian J Anaesth 2016;60:619-21. 2. Dickersin K, Chalmers I. Recognizing, investigating and dealing with incomplete and biased reporting of clinical research: From Francis Bacon to the WHO. J R Soc Med 2011;104:532-8. 3. Rosenthal R. The file drawer problem and tolerance for null results. Psychol Bull 1979;86:638...
متن کاملExamining publication bias—a simulation-based evaluation of statistical tests on publication bias
Background Publication bias is a form of scientific misconduct. It threatens the validity of research results and the credibility of science. Although several tests on publication bias exist, no in-depth evaluations are available that examine which test performs best for different research settings. Methods Four tests on publication bias, Egger's test (FAT), p-uniform, the test of excess sign...
متن کاملThe file-drawer problem revisited: a general weighted method for calculating fail-safe numbers in meta-analysis.
Quantitative literature reviews such as meta-analysis are becoming common in evolutionary biology but may be strongly affected by publication biases. Using fail-safe numbers is a quick way to estimate whether publication bias is likely to be a problem for a specific study. However, previously suggested fail-safe calculations are unweighted and are not based on the framework in which most meta-a...
متن کامل